Skip to content

Set unstable feed field - #1629

Merged
ianktc merged 4 commits into
mainfrom
import/update-unstable-feeds
Aug 25, 2026
Merged

Set unstable feed field#1629
ianktc merged 4 commits into
mainfrom
import/update-unstable-feeds

Conversation

@ianktc

@ianktc ianktc commented Aug 20, 2026

Copy link
Copy Markdown
Contributor

Updated Rule Set

Rule Catches
iso_date YYYYMMDD / - / _ / . separated, plus optional HHMM/HHMMSS
delimited_year standalone year 2010–2029, delimiter-anchored both sides
wordpress_upload_folder wp-content/uploads/[sites/N/]YYYY/MM/
dated_version_tag 2020.0401.1 style release tags
locale_date day-first 03.10.2025, 06-07-2021, 5.12.21
month_abbreviation_with_digits 3-letter month only fused to digits: coquimbo10feb16
version_query_parameter &version=20250220
epoch_timestamp 10-digit Unix seconds
month_name full month names, 6 languages
labelled_year 2025Winter, Spring2025, Q1-CY2025, CY2026
year_month bare YYYYMM — gtff-202311

csv detailing updated feeds after rules were removed:
unstable_producer_urls.csv

@ianktc
ianktc requested a review from emmambd August 20, 2026 20:48

@emmambd emmambd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! The main cases I've called out are:

  1. False positives where it looks like a date has been identified where it doesn't exist
  2. Feeds that have versions. I don't -think- we should treat these as unstable because versions could theoretically last for years, but I'm open to discussion on it

@@ -19,5 +19,6 @@
"direct_download": "https://transport-data-gouv-fr-resource-history-prod.cellar-c2.services.clever-cloud.com/79752/79752.20231005.100848.400086.zip",

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good - just noticing these France feeds could be redirected to TDG alternatives in many cases. Could be a separate issue

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will create a separate issue searching for redirects for these french feeds

Comment thread catalogs/sources/gtfs/schedule/pt-lisboa-carris-gtfs-2929.json

@emmambd emmambd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This LGTM now with the changes!

@ianktc
ianktc marked this pull request as ready for review August 25, 2026 20:51
@ianktc
ianktc merged commit ed6929e into main Aug 25, 2026
9 checks passed
@ianktc
ianktc deleted the import/update-unstable-feeds branch August 25, 2026 20:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants